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Project HEED (Heed Ethnic Educational Depolarization) 
involves over 1^000 Indian children in grades 1-8 in Arizona. The 
project target sites are 48 classrooms at Sells^ Topowa^ San Carlos^ 
Many Farms^ Hotevilla^ Peach Springs^ and Sacaton, Objectives are to 
increase: (1) reading achievementr (2) affective behavior of 
teachers^ (3) motivation by means of an open curriculum^ (4) 
effective Special Education programs^ and (5) involvement of parents 
in the school/community relations. Project HEED is evaluated for 
1971-72 by a variety of tests on a pretest and posttest basis. Among 
these are the Distar Mastery Test; Field Enterprise^ Special Needs 
Reading Series; Wide Range Achievement Testing; Self- A ppraisal 
Inventory; and the SRA Reading Comprehension and Vocabulary Tests. 
Some of the findings are: (1) a noted progress in reading achievement 
in nearly all classrooms; (2) an increase in self-image of the 
students; (3) an 8055 improvement in affective behavioral patterns of 
the teachers; and (U) a 7055 increase in parent involvement. Majority 
of the data is in tabular form by grade and school. (NQ) 
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INTRODUCTION 



The first year of the Title III Project, (Project HEED - Heed Ethnic 
Educational Depolarization), may be considered both a success and a fai 

Project management may take credit for the following accomplishments: 

(1) A very difficult Project was initiated at the target sites. 

(2) Educational materials were obtained and, in most cases, in- 
stalled in the classrooms. 

(3) An advisory -committee representing the various tribal groups 
.was established with the express purpose of assisting Project 
management . 

{h) Attention was given to problems of Special Education, as is 
required by Section 306, Title III. Special Ed classes were 
functioning at three target sites, specifically Sacaton, 
San Carlos Rice, and Sells. 

(5) Progress was noted in reading achievement in nearly all class- 
rooms . 

(6) Some in-service meetings were held to provide professional 
growth opportunities for participating teachers. 

(7) Several visits were made by Project management to the target 
sites, thus establishing a communications- link from Project 
management to the classrooms. 

(8) Testing for evaluation purposes was ?LCComplished as scheduled. 

(9) A few constructive field trips were conducted. 

(10) Study Social Rooms were established in the schools and used by 
the parents and other community representatives. 

(11) Project management has applied necessary corrections in a for- 
mative, manner to improve the probability of acconplishing 
Project objectives, suitably revised, during the second year. 

On the negative side, the following summary points were noted: 

(1) The scope of objectives was too broad, and in a few cases, 
objectives were unrealistic. 

(2) Project management was spread too thin in its effort to coor- 
dinate a statewide Project. 

(3) Teachers, in particular, felt'That the Project objectives had 
not been clearly explained to them. 
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The objective on reading achievement was unrealit;.tic in Lhat it 
failed to identify ,the proper entry "behavior of the children, 
insofar as grade equivalent level was concerned. 

The development of literacy skills involves considerably more 
than reading, and should at least include an oral language 
component . 

The objective on teacher affective behavior was never clearly 
articulated to the teachers by Project management, and consider- 
able resentment was generated as a consequence. The testing 
instrument lacked quantification and validity. 

The evaluation canponent to assess accomplishment of the teacher 
affective behavior was not carried out according to the evalu- 
ation design. The instrument selected for measurement in this 
area lacked quantification, and did not appear to be valid for 
the task. 

Motivational Kits were purchased but these were not placed into 
general classroom use. These Kits were appropriate for teachers, 
but not for students. 

Data on the self-appraisal inventories were not obtained anony- 
mously, as is specified by the publisher of the testing instru- 
ment . 

Reading passages on process evaluations were found to be highly 
inappropriate to both grade level and interest level of Indian 
children. 

Attendance at in-service meetings was poor, even though generous 
stipends had been assured. Poor attendance, in turn, reflects 
disinterest in the Project. 

Frequent changes in teacher assignment were noted in the special 
education classroom at one site, (Sells). 

Mont esorri. materia Is were purchased for special education children 
though not used in some instances. 

The abrupt resignation of the Project Director at about the mid- 
year point created a leadership problem for the balance of the 
year. The Project Coordinator had to assume additional duties 
as Acting Project Director and the combination "of both jobs was 
too much for any one person to handle. In retrospect, the 
Superintendent should have recruited a full time Project Director 
immediately following the resignation. 

Test administration, as reported by some Principals at the sites, 
left much to be desired. (This comment stems from pre-testing. 
Mature educators frcm the Albuquerque Public Schools were em- 
ployed to assist SWCEL in post-testing). 
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(16) The Advisory Committee did not have a set of by-laws, and while 
the intent of the committee is clear, its effectiveness was 
limited. Some sites were not represented on this committee. 

(17) One field trip appeared Unproductive and wasteful of project 
monies . 

(18) Project management had poor liaison within the Sacaton site, 
even though this was Project Headquarters. 

(19) The assigned community representative to Project Management 
was not employed to fullest advantage. 

(20) Special Education classes were available at three sites, but 
in view of the requirements of Title III, Section 306, that 

at least 13% of the Project effort be devoted to Special Educa- 
tion, it would appear that more could have been done for handi- 
capped children at Peach Springs, Hotevilla, and Many Farms. 

(21) The role of the Project Director in terras of relationships with 
principals at the target site schools, the role of these prin- 
cipals in terms of relationship to the Project, and the role of 
the Superintendent at Sacaton to the Project Director and to the 
Advisory Committee, all need clai'if icat ion. Some problems arose 
during the first year of the Project because the lines of 
authority were not clear. 

(22) The normal functions of educational program auditing were not 
performed in a consistent, thorough manner, due to the fact 
that there was no independent educational program auditor 
assigned to the Project. The auditor contracted to do this 
important task was a Certified Public Accountant, and not an 
Educational Program Auditor. 

SCOPE OF PROJECT & ORGANIZATION 

Project HEED, the acronym for Heed Ethnic Educational Depolarization, 
involved over 1000 Indian children in k8 separate classrooms at the . 
following target sites in Arizona; Sells, Topowa, San Carlos, Many Farms, 
Hotevilla., Peach Springs, and Sacaton. 

The expansiveness of the .Project can be illustrated by reference to the 
map of Arizona, which depicts the numbers of children in the Project and 
their tribal affiliation. 
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Project HEED, for its initial year, had five general oojectives. Those 
objectives were: 

(1) To increase reading achievement 

(2) To increase affective behavior of teachers 

(3) To increase motivation by means of an open curr.iculiun 
{h) 't'o Jncrease effective Special Education pro/'irams 

(5) 'I'o increase Involvement of parents in the schooJ /coinrnuniLy relation 

The selection of these oojectives reflects very thorough i^lannlng on the 
part of Project management at the outset. The rationale for these 
objectives, applicable to any of the target sites, might be expressed 
as follows: 

( 1 ) Reading : 

Indian children are disadvantaged in comparison with Anglos or 
Mexican-Americans of the same age for they have not had the seime 
opportunities to develop pre-reading skills. Upon entering school, 
the Indian child is already behind his Anglo or Mexican-American 
contemporary in grade level reading skills. His home environment 
does not provide the reinforcement for developing these skills to 
the same degree that children of other cultiures enjoy. 

Since reading is a fundamental literary skill, improvement in 
reading ability should assist the Indian child to compete 
successfully with children of other cultures. 

(2) Affective Behavior 

American Indian students are usually taught by non-Indian teachers. 
Curriculum development is usually designed by non-Indian educators. 
These curricula often create barriers and frustrations which Indian 
students have difficulty processing. The conmunication in the 
classroom between teacher and student includes a non--verbal com- 
ponent which, according to one authority, constitutes at least 
10% of the total communication. The teacher's affective behavior, 
■ as perceived^ by the student, sets the emotional environment and 
is a primary influence for motivating the learner. 

An improvement in the teacher's affective behavior, as this 
relates to cultural awareness and understanding of value orien- 
tations, should be accompanied by a corresponding improvement 
in the learning process. 

(3) Motivation 

line learner mus.t be motivated to learn, or the learning process 
will fail to .take place. Whatever else the teacher might do, her 
fundamental task is to develop and maintain a high interest in 
learning on the part of the student. No matter how qualified in 
subject matter, a teacher might be, if she is unsuccessful in 
efforts to make the child want to learn, the probable effects 
are that the child will not learn. 
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(3) Motivation (cont.) 



The high drop-out rate for Indian children indicates that in rnuny 
ca.seF> these children are not motivated by school activity ♦ Atten- 
dance patterns a].so reflect this lack of interest. In the mind of 
the Indian child, the society outside of the school rnay well pro- 
vide more meaningful experiences to him than does tho society 
within the school. A school curriculum which concentrates on 
improvement in motivation, by whatever means, should ttieoreti- 
cally benefit the Indian child, 

{h) Special Education 

Needs assessment data from research conducted by the Bureau of 
Indian Affairs substantiate the high proportion of handicapped 
Indian children in the rural areas of Arizona. The highest single 
category involves children with hearing handicaps, possibly a 
result of a widespread incidence of Rubella, (German Measles), 
during the mid-1960's. The fact that the Indian child grows up 
in a rural setting, in relative isolation from urban environments, 
tends to add to the problem, for the opportunity for community 
health clinics, and normal sources of referral, are often lacking. 
The services to deal effectively with problems of Special Educa- 
tion have logically been concentrated in areas of population den- 
sity, and as a consequence, the Indian child again is disadvan- 
taged, when compared to his Anglo, and to a lesser extent, 
Mexican-American counterpart in the Southwest. 

A comprehensive, systematic program designed to improve the 
educational opportunities for handicapped Indian children re- 
quires more than one year to implement, but any effort in this 
direction, however small, appears justified. 

(5) Parental Involvement 

The child spends considerably more of his time at home than he 
does at school. The influence of the parent, unless the cir- 
cumstances aire ^ unusual, supercedes the influence of the teacher, 
according to; specialists in early childhood education. Survival 
is the most primitive need, and it is the home which satisfies 
the requirements of food, water, clothing, and shelter. 

Interest and participation by the parents in the life of the 
school can complement the educational goals set by the school 
authorities, in the sense thai: the parental involvement rein- 
forces the efforts of the school. This has the effect of pro- 
viding a carry-over function ,'• and the child tends to accept 
school life on -a basis not in competition with family life. 

The organization for implementing these objectives through the 
various target sites functioned" from a Headquarters in Sacaton, 
Arizona. The full time staff included a Project Director, a 
Project Coordinator, a Community Representative, and a Secre- 
, tary. This staff was subordinate to the Superintendent of the 
Sacaton Public Schools . ' : 

.The Project Management staff coordinated the activities of the 
'-Project on a day-to-day basis-. .Such activities included the 
'' "■procurement and dissemination. 6f educational materials, the 
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planning of in-service training institutes, the arrangements for 
connuli/ing services (as these vere necessitated), the visitation 
to tfirfiol. r, i.tos for (*:i.rst-hand observations of the Project at 
tlu? o'l.'iGrroom lovo I , n.iul liaison with va.r .iour'. r.roupi; con('f?rrilnr, 
l'roJ(^c(. tmittefs, (i.e. Advisory coimnitLop, It'odoru'l /ukI 
orriciala). The Project Staff isnued n pc^riodic ric.'w;;:ifl.(.(;r ui; 
a primary means of reporting significant events as thcKc took 
place from site to site. 

Project management ,. in conjunction with the Southwestern Cooper- 
ative Educational Laboratory, ceirried* out the internal evaluation 
function, 

A critical point in the first year developed when the Project 
Director resigned. The Project Coordinator assumed additional 
duties as Acting Project Director, Some of the uncertainties 
on the part of participating teachers as to Project Goals and 
objectives must be attributed to the fact that Project Management , 
following the resignation of the Director, had too many respon- 
sibilities to handle with a reduced staff. An organization which 
provided for some degree of decentralisation of leadership author- 
ity to the target site level on a formal basis might have proven 
more effective in the implementation process, 

EVALaATION DESIGN & EVALUATOR'S REPORT 

This section of the report will follow the evaluation design, 
1, General Objective 

To increase the achievement cf -students in reading, 

1,1 Performance Objective 

As a result of the application and utilization of reading programs 
(Distar K-3, and Field Enterprise, Special Needs Reading Series 
Grades ^-8), ^0% of the K-3 and 60% of the ^+-8 students in the 
target population will be reading at grade level by June 1972 as 
evidenced by results of standardized reading tests, 

1.1.1 A Project Director was employed to project leadership for this 
phase of the Project, A' secretary was also employed. 

The Project Director was a former teacher, with especial know- 
ledge in teaching the Distar Reading Program, 

The resignation of the Project Director and its effects upon 
the Project have been previously discussed, 

1.1.2 Reading materials were purchased and distributed to the target 
sites. At TOPOWA, the Distar materials were not implemented 
in the 1st grade classroom, for the reason that the teacher 
preferred other reading programs. It must be recognized that 
there are a variety of reading programs, that there are a variet 
of approaches for teaching reading, and that children learn to 
read differently, A reading program which best suits one child 
does not necessarily work for all children, Distar reading is 
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hif!;hIy-structiirod 5 and represents ti prof^irani dea 'witiod lo abtaok 
words This has proven to be effective with disadvantaged 
children, 'ITiere are other programs which stress meaning to a 
greater degree. 

lliere was no full-scale pre-service workshop for the teachers. 
Teachers, in most cases, started out the 1971-197^^ school year 
unaware of the goals and objectives of the Project. Some of 
the teachers had attended Distar Reading Institutes. 

1.1.3 Project management had a late model, air-conditioned vehicle 
assigned on a full time basis. The vehicle was utilized 
effectively, having over 20,000 miles during the Project year. 

1.1. U Several teachers and aides participated in SRA conducted work- 
shops designed to prepare teachers for using Distar reading 
materials . 

It is believed that the upper level teachers did not have a 
similar opportunity to learn about Field Enterprise materials. 
(This comment is based upon conversations with teachers and 
the Acting Project Director). 

1.1.5 During site visitations, Distar teachers vere observed on a 
frequent basis by Project management staff. Observation sche- 
dules, patterned along the lines of the SWCEL Oral Language 
Program observation schedule, were used to monitor teacher per- 
formance in reinforcement, modeling, teaching cues, etc. Post- 
observation conferences were held in order to assist teachers 

.in maintaining their Distar teaching skills. 

While this task was handled in a highly excellent manner, 
there did not appear to be the same effort devoted to monitor- 
ing reading activities in the upper grade levels. 

It is also possible that the reading specialist assigned to 
the school, (i.e. Mrs. Colcord at Peach Springs), might have 
been used more extensively to assist Project management in 
this function . 

1.1.6 Project management did publish a monthly newsletter which 
featured a variety of activities, (i.e. Junior Rodeo, field 
trip, reading programs, social studies rooms, etc.). A 
review of these newsletters indicates that the sites were not 
universally cooperative in furnishing articles for publication. 
St. Charles Mission at San Carlos was the outstanding contri- 

• butor. The difficulties of publishing such a newsletter, not- 
withstanding, it would appear that more decentralization of 
management to the site* level could result in increased respon- 
siveness. 

1.1. T Regular classroom students in grades 2-8 were administered the 
SRA Reading Achievement Test on a pre-post basis. The test 
instruments measured reading comprehension and vocabulary 
skills. Grade equivalents are based upon national norms, not 
norms for Southwest Indian children. Fran analysis of pre-test 
scores, it is clearly evident that the average child was far 
below grade level, and that the performance objective cited in • 
Section 1.1 is unrealistic. 
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i. J. .7 (conL. ) 



The pages which rollow report mean /^irade equivalent nooreD> by 
/Trade level niul by jsite, for both compreheneion and vocabulary- 
and on a pre-post basis. The form and level of the tei5L inahru- 
ment is indicated. 

ITie reader may detect a slight variance in f^rade equivalents when 
comparing the results reported in these pages with those cited 
in the general statistical treatment. (See Addendum) 

Grade equivalents in the following pa/^es were determined by 
converting the mean raw score for a class to a mean grade 
equivalent score . 

The statistical treatment, on the other hand, has averaged each 
child's grade equivalent score. Grade equivalents peak out at 
both the upper and lower ends of the distribution of scores, 
and this accounts for the slight variations in the data. 
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Mean Scores as Grade liJquivalenta 
Comparison by Sites 
Second Grade 

Comprehension Vocabulary 



Site 


Group 


Pre 


P0£3t 


Gain 


Pre 


Post 


Gain 




A 


1.7 


2.3 


0.6 


1.6 


2.5 


0.9 




Jd 


1 Q 








2.5 


0.3 




A 




2.0 


0.6 


1.8 


2.3 


0.5 




•D 

JD 


1 .o 


<^.3 


o.y 




2.3 


1.1 




A 


1.6 


2.2 


0.6 


1.8 


2.4 


0.6 




B 


1.^ 


2.4 


1.0 


1.9 


2.4 


0.5 




A 


1.3 


1.4 


0.1 


1.3 


1.9 


0.6 




•Q 

Jt) 


1«1 


l.P 


0.4 


1.9 


1.9 


0.0 


darlcs 


♦ A 


2.3 


2.8 


0.5 


2.3 


2.9 


0.6 




* 
















B 




2.5 


0.1 


2.2 


2.6 


0.4 




A 


1.1 


1.9 


0.8 


1.5 


1.6 


0.1 




B 


1.3 


1.5 


0.2 


1.1 


1.8 


0.7 



A group took Form C as pre test and Form D as post test 
B group took Form D as pre test and Form C as post test 

Test instrument SRA Level 2-^, Reading Comprehension and Vocabulary 

* Second grade children at San Carlos Mission were significantly 
better in reading comprehension skills at pre test time than 
any other group, at the 1 % level. 
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Mean Scores as Grade Equivalents 
Comparison by Sites 

Third Grade 







Coinprehensioa 


Vocabulary 




Site 


Group 


Pre 


Post 


Gain 


Pre 


Post 


Gain 


V? ^% 0^ flH^ 4* 


A 


2.3 


2.7 


0.4 


2.3 


2.7 






B 


2.2 


2.3 


0.1 


2.4 


2.1 


-0.5 


xeacn opnngs 


A 


1.6 


1.9 


0.5 


2.0 


1.8 






B 


1.7 


1.7 


0.0 . 


2.0 


1.8 


-0.2 


Many Farms 


A 


1.9 


2.2 


0.3 


2.2 


2.4 


0.2 




B 


1.8 


2.3 


0.5 


1.9 


2.4 


0.5 


Hotijsvilla 


A 


2.2 


2.5 


0.3 


2.6 


3.1 


0.5 






1.9 


2.1 


0.2 


2.2 


2.5 


0.1 


ban Carlos 


A 

A 


2.6 


3.3 


0.7 


2.3 


2.9 


O.D 


Mission 


















* B 


P.-L 


o+ 


<;.9 


O Q 




2.1 


San Carlos 


A 


2.1 


2.6 


0.5 


2.4 


2.6 


0.2 


Rice 
















B 


2.0 


2.5 


0.3 


2.1 




0.3 


Topowa 


A 


1.7 


2.^ 


0.7 


1.8 


2.^ 


0.6 




B 


1.7 


1.8 


0.1 


1.3 


1.7 


0.4 


A group took Form C as 


pre 


test amd 


, Form D 


as post test 





B group took Form D as pre test and Form C as post test 



Test iastrximent SRA Level 2-4 Reading Comprehension and Vocabular 

* San Carlos Mission B group did significantly better on both 
reading comprehension and vocabulary tests at post testing 
than any other group. (1% level) 
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Mean Scores as Grade Equivalents 
Comparisom by Sites 
Fourth Grade 

Comprehension Vocabulary 



3it« 


Group 


Pre 


Post 


Gain 




Pre 


Post 


Ga in 


Sacaton 


A 


2.3 


2.8 


0.5 






2.6 






B 


2.4 


2.8 


0.4 




* 


2.6 




Peach Springs A 


2.4 


3.0 


0.6 




2.4 


3.2 


0.8 




B 


2.3 


2.6 


0.3 




2.3 


2.8 


0.5 


Maay Farms 


A 


2.2 


2.6 


0.4 




2.1 


2.8 


0.7 




B 


2.2 


2.5 


0.1 




2.2 


2.2 


0.0 


Hotevilla 


A 


2.5 


2.9 


0.4 




2.6 


2.6 


0.0 




B 


2.6 


3.3 


0.7 




2.6 


2.9 


0.3 


oan Carlos 


A 


2.4 


2.6 . 


0.2 




2.5 


2.4 


-0.1 


Rice 




















B 


2.7 


2.7 


0.0 




2.7 


2.7 


0.0 


Topowa 


A 


2.5 


3.1 


0.6 




2.3 


2.8 


0.5 




B 


2.5 


2.8 


0.3 




2.6 


2.8 


0.2 


A group 


took Form 


C as 


pre test and 


Form 


D as 


post 


test 


B group 


took Form 


D as 


pre te 


st and 


Form 


0 as 


post 


test 



* Fourth grade children at Sacatoa were aot pre-tested 
in vocabulary skills 

Test instrument SRA Level 2-4 Reading Comprehension and Vocabulary 
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Mean Scores as Grade Equivalents 
Comparioon by Sites 
Fifth Grade 



Comprehension Vocabulary 



Site 


Group 


Pre 


Tost 


Gain 




Pre 


Post 


Gain 


Sacaton 


A 


5.2 


5.1 


-0.1 




5.1 


5.1 


0.0 




B 


5.1 


5.1 


0.0 




5.4 


5.1 


-0.5 


Feach Springs A 


5.9 


4.5 


0.6 




5.8 


4.6- 


0.8 




B 


5.1 


4.2 


1.1 




5.5 


4.1 


0.8 


Many Farms 


* A 




5.5 


0.8 




4.6 


5.7 


1.1 




B 


5.7 


5.5 


-0.4 




5.8 


3.5 


-0.3 


Hotevilla 


A 


5.9 


4.5 


0.6 




5.8 


4.1 


0.5 




B 


4.0 


4.7 


0.7 




4.1 


4.7 


0.6 


San Carlos 


A 


5.9 


4.4 


0.5 




3.9 


4.5 


0.6 


Hice 




















B 


5.5 


4.2 


.0.9 




4.0 


4.5 


0.5 


Topowa 


A 


5.4 


4.1 


0.7 




3.2. 


4.4 


1.2 




B 


5.1 


4.5 


1.2 




3.5 


■ 4.2 


0.9 


L group took 


Form C as 


pre 


test and 


Form 




as post 


teat 




I group took 


Form D as 


pre 


test and 


Form 


C 


as post 


test 





Test instrument SRA Multilevel/ Blue Beading Comprehension and 

Vocabulary 

* list ny Farm i5 group A performed significantly better than any other 
group in both comprehension and vocabulary skills at post test 
time. Many Farms group A was noticeably superior to other ..groups 
in both comprehension, and vocabulary skills at pre test time. 
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Mean Scores as Grade Equivalents 
Comparison by Sites! 



Sixth Graide 
Comprehension Vocabulary 



Site 


Group 


Pre 


Post 


Gain. 


Pre 


Post 


Gaia 


Sacaton 


A 




5.0 


1.0 


4.1 


5.5 


1.2 




B 


^.1 


^.7 


0.6 


4.4 


4.8 


6.4 


Peach Springs 


A 


5.1 




1.8 


5.1 


4.8 


1.7 




B 


5.5 


5.^ 


0.1 


5.2 


4.0 


0.8 


Hotevilla 


A 


5.9 


5.2 


1.3 


5.7 


4.7 


1.0 




B 


^.5 


5.1 


0.8 


5.7 


4.5 


0.6 


San Carlos 


A 




5.7 


0.5 


5.4 


5.8 


0.4 


Rice 


















B 


5.2 


^.2 


1.0 


5.8 


5.7 


-0.1 


Topowa 


A 


5-7 




0.7 


. 3.8 


4.4 


0.6 . 




B 


5.8 


4.6 


0.8 


3.8 


5.0 


1.2 


Sells 


A 


5.1 


5.5 


0.4 


4.0 


4.2 


0.2 




B 


5.7 




0.4 


4.1 


4.3 


0.2 


k group took Form C as 


pre test 


and 


Form T) as 


post test 




B group took Form D as 


pre test 


and 


Form C as 


post te 


st 





Test instrument SRA Multilevel/ Blue Reading Comprehension and 

Vocabulary 



riean Scores as Grade Equivalents 
Comparison by Sit^s 
oeventh Grade 



Comprehension Vocabulary 



Site 




Pre 




<5+: 

o U 




X X o 






Sacaton 


A 


4 


.0 


6. 


0 


2.0 


4.2 


5.7 


1.5 




B 


3 


.6 


5. 


2 


1.6 


^.5 


5.7 


1.2 


Peach Springs 


A 


5 


.2 


6. 


0 


2.8 


4.0 


5.3 


1.3 




B 


3 


.9 


5. 


9 


2.0 


4.6 


5.8 


1.2 


San Carlos 


A 


3 


.3 


4. 


1 


0.8 . 


4.0 


4.2 


0.2 


pice 






















* B 


3 


.2 


4. 


3 


1.1 


4.0 


3.6 


-0.4 


Sells 


A 


3 


.2 


4. 


1 


0.9 


3.5 


^.5 


1.0 




B 


3 


.3 


4. 


3 


1.0 


3.8 


4.2 


0.4 



A group took Form C as pre test and Form D as post test 

B group took Form D as pre test and Form C as post test 

Test instrument SRA Multilevel/ Blue Reading Comprehension and 

Vocabulary 

* San Carlos Rice B group did significantly poorer than other 
groups on vocabulary skills. 
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Mean Scores as Grade Equivalents 
Comparison by Sites 
Eighth Grade 



oxte 


Group 


Comprehensioa 


Vocabulary 




Pre Post 


Gain 


Pre 


Pont 


Gain 


iSacaton 


A 


4.0 


6.0 


2.0 


^.3 


5.6 


1.3 




B 


3.6 


5.7 


1.9 


3.9 


6.0 


2.1 


Peach Springs 


A 


3.6 


5.0 


1.4 


3.9 


5.2 


1.3 




B 


3.7 




1.2 


4.1 


5.5 


1.4 


JSan Carlos 


• * A 


3.1 


4.0 


0.9 


4.0 


3.8 . 


-0.2 


Rice 
















B 


3.1 


4.0 


0.9 


3.3 


4.4 


1.1 


Sells 


■ A 


3.1 


6.2 


3.1 


3.1 


5.2 


2.1 




B 


3.2 


4.9 


1.7 


3.3 


5.2 


1.9 ; 

i 


A group took 


Form C as 


pre test 


and 


Form D: as 


post 


test 




B group took 


Form D as 


pre test 


and 


Form C as 


post 


test 





Test instruirient SSA Multilevel/ Blue Keading Comprehension and 

Vocabulary 



* San Carlos Rice A group did significantly , poorer on vocabulary 
poot test than other groups 
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Mean Scores as Grade Equivalents 
Topowa 

Compreh«nf:.ion Vocabulary 



Grade 


Group 


Pre 


Post 


Gain 


Pre 


Post ( 


j-ain 


2 


A 


1.1 


1.9 


0.8 


1.5 


1.6 


0.1 




B 


1.3 


1.5 


0.2 


1.1 


1.8 


0.7 


3 


A 


1.7 


2.4 


0.7 


1.8 


2.4 


0.6 




B 


1.7 


1.8 


0.1 


1.3 


1.7 


0.4 


4 


A 


2.5 


3.1 


0.6 


2.3 


2.8 


0.5 




B 


2.5 


2.8 


0.3 


2.6 


2.8 


0.2 


5 


A 


3.4 


4.1 


0.7 


3.2 


4.4 


1.2 




B 


3.1 


4.3 


1.2 . 


5.3 


4.2 


0.9 


6 


A 


3.7 


4.4 


0.7 


3.8 


4.4 


0.6 




B 


3.8 


4.6 


0.8 


3.8 


5.0 


1.2 


A group 


took 


Form C 


as pre 


teat and 


Form D 


as post 


test 


B group 


tool 


Form D 


as pre 


test and 


Form C 


as post 


test 



Test instruments Grades 2-4 SRA Level 2-4 

Reading Comprehension 
and Vocabulary 

Grades 5 & 6 SRA Multilevel/ Blu« 

Reading Comprehension 
and Vocabulary 



(IT) 



ERIC 



Mean Scores as Grade .fi'cjuiv^lents 
San Car] 06 Rice 

Comprehension Voc^ibiilary 



Grade 


.i-roup 


I 're 


I'oat 


da in 




Pre 


lost 


Gain 


3 


A 


2.1 


2.6 


0.5 




2.^ 


2.6 


0.2 




B 


2.0 


2.3 


0.3 




2.1 


2.^ 


0.3 




A 


2.^ 


2.6 


0.2 




2.5 


2.^ 


-0.1 




B 


2.7 


2.7 


0.0 




2.7 


2.7 


0.0 


5 


A 


3.9 




0.5 




3.9 


4.5 


0.5 




B 


3.3 


4.2 


0.9 




4.0 


4.3 


0.3 


6 


A 


3.4 


3.7 


0.3 




3.4 


3.8 


0.^ 




B 


3.2 


■ ^.2 


1,0 




3.8 


3.7 


-0.1 


7 


A 


3.3 


^.1 


0.8 




^.0 


^.2 






B 




^ . ^ 


1.1 




^.0 


3.6 




8 


A 


3.1 




0.9 




^.0 


3.8 


^0.2 




B 


3.1 




0.9 




3.3 




1.1 


A group took 


Form C 


as pre 


test 


and 


Form 


D as 


post test 


B group took 


Form D 


as pre 


test 


and 


Form 


C as 


post test 



Test instruments Grades 2--^ SRA Level 2-^ 

Reading Comprehension 
and Vocabulary 

Grades 5-^8 SRA Multilevel/ Blue 

Reading Comprehension 
and Vocabulary 
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Mean Scores as Grade Equivalents 
San Carloa Mission 



Oomprehennion Vocabulary 

Grade Group I're Post Gain Pre Post Gain 

2 A 2.5 2.8 0.5 2,5 2.9 0-6 

B 2,^ 2.5 0.1 2,2 2.6 0.^ 

5 A 2.6 3.3 0.7 2.3 2.9 0.6 

B 3.1 6+ 2.9 2.9 5.0 2.1 



A group tockForm C pre test and Form D -as post test 
B group took Form D as pre test and Form C as poat test 



Test instrument Grades 2&3 SRA Level 2-4 

Reading Comprehension 
and Vocabulary 
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Mewn Scores as Grade Equivalenta 
Hotevilla 



Grade 


Group 


Comprehension 
Pre Poat Gain 


Vocabulary 
Pre Post Gain 


2 


A 


1.3 




0.1 


1.3 


1.9 


0.6 




B 


1.1 


1.5 


0.4 


1.9 

• ✓ 


1.9 


0.0 


3 


A 


2.2 


2.5 


0.3 


2.6 


3.1 


0.5 




B 




2.1 


0.2 


2.2 


2.3 


0.1 




A 


2.5 


2.9 


0.4 


2.6 


2.6 


0.0 




B 


2.6 


3.3 


0.7 


2.6 


2.9 


0.3 




A 


3.9 


4.5 


0.6 


3.8 


4.1 


0.3 




B 


4.0 


4.7 


0.7 


4. 1 


4.7 


0.6 


6 


A 


3.9 


5.2 


1.3 


3.7 


4.7 


1.0 




B 


4.3 


5.1 


0.8 


3.7 


4.3 


0.6 


A group took 


Form C 


as pre 


test and 


Form D 


as post 


test 


B grouj) took 


Form D 


as pre 


test and 


Form C 


as post 


test 


Test 


instruments 


Grade 


s 2-4 


SRA Level 2-H 





Reading Comprehension 
and Vocabulary- 



Grades 5&6 SRA Multilevel/ Blue 

Reading Compreliension 
and Vocabulary 
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Mean Scores as Grad<» Equivalents 

Many Fanaa^ 

Comprehension Vocabulary 

Grade Group Pre Post Gain Pre Post Gain 



2 A 


1.6 


2.2 


0.6 


1.8 


2.4 


0.6 


B 


1.4 


2.4 


1.0 


1.9 


2.4 


0.5 


3 A 


1.9 


2.2 


0.3 


2.2 


2.4 


0.2 


B 


1.8 


2.3 


0.5 


1.9 


2.4 


0.5 


4 A 


2.2 


2.6 


0.4 


2.1 


2.8 


0.7 


TJ 






VJ.l 


£1 • 




U.vJ 


5 A 




5.3 


0,8 




J • ( 


1-1 


B 


3.7 


3.5 


-0.4 


3.8 


5.5 - 


-0.3 


A group took 


Form C as pre 


test and 


Form D ■ 


as post 


test 


B group took 


Form D as. pre 


teat and 


Form C as post 


test 


Test iaffltrumentis 


Grades 2-4 


SRA 


Level 2 


-4 



Reading Comprehension 
and Vocabulary 

Grade 5 SHA Multilevel/ Blue 

Reading Comprehensiom 
and Vocabulary 
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Mean Scores as Grade 
Sacaton 



Equivalents 



Comprehension 



Vocabulary 



Grade 


Group 


• Pre 


Post 




Pre 


Post- 


Gain 


2 


A 


1.7 


2.3 


0.6 


1.6 


2.5 


0.9 




B 


1.9 


2.3 


0.4 


2.2 


2.5 


0.3 


3 


A 


2.3 


2.7 


0.4 


2.3 


2.7 


0.4 




B 


2.2 


2.3 


0.1 


2.4 


2.1 


-0.3 


4. 


A 


2.3 


2.9 


0.5 


* 


2.6 






B 


2.4 


2.8 


0.4 


* 


2.6 





5 


A 


3.2 


3.1 


-0.1 




3.1 


3.1 


0.0 




B 


5.1 


3.1 


0.0 




3.4 


3.1 


-0.3 


6 


A 


4.0 


5.0 


1.0 




4.1 


5.3 


1.2 




B 


4.1 


4.7 


0.6 




4.4 


4.8 


0.4 


7 


A 


4.0 


6.0 


2.0 




4.2 


5.7 


1.5 




B 


3.6 


5.2 


1.6 




4.5 


5.7 


1.2 


8 


A 


4.0 


6.0 


2.0 




4.3 


5.6 


1.3 




B 


3.6 


5.7 


1.9 




3.9 


6.0 


2.1 


A 


group took 


Form C 


as pre 


test 


and 


Form D as 


post 


test 


B 


group took 


Form D 


as pre 


test 


and 


Form C as 


post 


test 



* 4th graders at Sacaton were act givea vocabulary sub-test 
during pre-testing 



Test iastruments 



Grades 2-4 



Grades 5-8 



SRA Level 2-4 
Reading Compreheasioa 
and Vocabulary 

SRA Multilevel/ Blue 
Reading Comprehension 
and Vocabulary 



ERIC 
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Mean Scores aa Grade i^quivalents 



Grade Group 


Peach Springs 

Comprehension 
Pre Poot Gain 


Vocabulary 
Pre Post 


Gain 


2 A 




2.0 


0.6 


1.8 


2.3 


0.5 


B 


1.6 


2.3 


0.7 


1.2 


2.3 


1.1 


3 A 


1.6 


1.9 


0.3 


2.0 


1.8 


-0.2 


B 


1.7 


1.7 


0.0 


2.0 


1.8 


-0.2 


4. A 


2.^ 


3.0 


0.6 


2.4 


3.2 


0.8 


B 


2.5 


2.6 


0.3 


2.3 


2.8 


0.5 


5 A 


3.9 


^.5 


0.6 


3.8 


4.6 


0.8 


B 


3.1 


^.2 


1.1 


3.3 


4.1 


0.8 


6 A 


3.1 


^.9 


1.8 


3.1 


4.8 


1.7 


B 


3.3 


3.^- 


0.1 


3.2 


4.0 


0.8 


7 A 


3.2 


6.0 


2.8 


4.0 


5.3 


1.3 


B 




? . y 






5.8 


1.2 


8 A 


3.6 


5.0 




3.9 


5.2 


1.3 


B 


3.7 


4.9 




4.1 


5.5 


1.4 


A group took 


Form C as 


pre 


test and 


Form D 


as post test 


B group took 


Form D as 


pre 


test and 


Form C 


as post test 



Teot Instruments Grades 2-4 SRA Level 2-4 

Reading Comprehension 
and Vocabulary 

Grades 5-8 SRA Multilevel/ Blue 

Reading Comprehension 
and Vocabulary 

Er|c (23) 



Mean Scores as Grade Equivalents 
Gells 



Grade Group 
6 A 
B 



7 A 3.2 ^.1 0.9 3.5 ^.5 1.0 

B 3.3 ^.3 1.0 3.8 ^.2 0.^ 



8 A 3.1 6.2 3.1 3.1 5.2 2.1 

B 3.2 ^.9 1.7 3.3 5.2 1.9 



Comprehe&sioB 
Pre Post G;aia 

3.1 3.5 0.4 

3.7 ^.1 0.4 



Vocabulary 
Pre Post Gain 

4.0 4.2 0.2 

4.1 4.3 0.2 



A group took Form C as pre test and Form D as post test 
B group took Form D as pre test aad Form C as jHDst test 



Test instrument Grades 6-8 3RA Multilevel/ Blue 

Reading Comprehension 
and Vocabulary 



(24) 



l.l.T.l For re'giilar claBorooina, it may be concluded (.hat; 

(l) The pcrrormancu objective was not mob, thou/rh in all I'air- 
noBn, wan unrealistic. 

(p) Oonr. iderab.l e improvoment in reading {skills wan evidenced, 

pfir l.iou 1 ar'ly in Lhe upper ^.radec . {it is ponnihlo Lhat Ihe 
Form of iho Letit - SHA Multilevel - with a total' admini- 
sLration time of 70 minutes, was a factor contributing to 
this greater achievement). 

(3) At the second grade level, the children at St. Charles 
Mission, San Carlos, ware significantly better readers 
than children at the other sites, based upon entry 
behavior determined at pre-testing. 

{k) The third grade teacher at Peach Springs had little success 
in reading, and it is doubtful whether the educational 
materials were used effectively in this classroom. 

(5) The St. Charles Mission third grade teacher realized the 
largest gains of • any teacher in the lower primary grades. 

(6) Children in the fifth grade at Sacaton did not make pro- 
gress in reading skills. The assigned teacher was absent 
due to illness for an extended period during the school 
year. 

(T) The 5th grade classroom at Many Farms appeared to be sub- 
divided into a "good readers" and "poor readers" grouping. 
Results indicate excellent growth for the former, and 
regression for the latter. 

(8) The 6th grade teacher at Peach Springs achieved an improve- 
ment of nearly 2 grade levels for h of her class. 

(9) Seventh grade teachers at Peach Springs and Sacaton realized 
more than a grade equivalent increase in both comprehension 
and vocabulary, based on the entire class average. 

(10) Eighth grade students at all target sites excepting San 
Carlos Rice demonstrated remarkable improvement, in one 
case three grade level equivalents (Sells). 

1.1.7.2 Process evaluation for reading achievement involved the admini- 
stration of short tests to measure proficiency in comprehension 
and vocabulary. Results from these tests were to be correlated 
with observation data to determine effects of teacher behavior 
oh reading achievement. 

Numerous complaints were received from teachers, and in some 
cases, principals-, about these tests. The objections centered 
around the inappropriateness for both interest level and grade 
level, as well as poor test design. 

The SWCEL Evaluator and the acting Project Director agreed 
mutually to discontinue the process evaluation. SWCEL engaged 
a Reading Specialist Consultant to review these tests, and it 
was determined that some of the passages were 12th grade level, 
forx example, rather than 7th/8th grade level, based upon the 
Dale-Chill formula. 
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l,l,7-2 (contj 

The consultant's full report is included in the Addendum. 

1.1.7.3 Children in regular classrooms in grades K-2 were administered 
the Distal' Mastery Test on a post basis only. Exceptions to 
these included TOPOV/A, where the children had not been instructed 
in Distar, and at St. Charles Mission, where there were not 
enough Distar Mastery I test booklets available to test the 
Kindergarten children. 

The Distar Mastery Teut is criterion referenced, assessing whether 
specific objectives of the Distar prograin have been met satisfac- 
torily. It cannot be used as an achievement test 5 nor can raw 
score results be converted to grade equivalents. 

Results of the Distar Mastery Tests indicate that the objectives 
of the program iare being met. Statistical treatment of these 
tests are included in the addendum. 

A chi-square treatment was employed to relate teacher behavior, 
as observed by a trained observer, to results on these Mastery 
Tests. Basically, there was little variance from one teacher's 
behavior to another, as reflected in the observation schedules. 

While Distar Mastery Tests cannot be considered as a valid 
instrument for assessing the performance objective, it is impor- 
' tant to note that the achievement reported by 2nd graders, 
(from SRA Testing), was better in the case of Distar classrooms 
than in non-Distar classrooms. This point needs farther inves- 
tigation. 

1.1.7.U Children at TOPOWA, 1st grade, were given the Wide Range Achieve- 
ment Test in. lieu of the Distar Mastery Test. This substitution 
met with the approval of the TOPOWA Principal and classroom 
teacher . 

Results are reported in the Addend\im. 
General Objective 

To increase the affective behavior patterns of staff members in the kQ 
target classrooms. 

2.1 Performance Objective 

Eighty per-cent of the U8 staff members at the six selected sites 
will, by June 1972, as a result of simulated minority-majority 
cultural role-playing situations, and introduction and utilization 
of the interaction analysis technique, improve their affective 
behavioral patterns, as evidenced by an affective gain in the 
results of the pre-post interaction analysis individuals patterns 
and by utilization of an affective behavior rating scale to be 
developed. 

2.1.1 A Program Coordinator was employed to provide instructional leader- 
ship and program monitoring at the target sites. This individual 
also assumed duties as Acting Project Director during the last 
half of the school year. 
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2.1.2 Frequent efforLr, Vvom the SWCEL Evaluator to determine IT an inservice 
workshop was held at the target sites Tor the express purpose of 
explaining this objective lead to the conclusion that it was not 
accomplished. Conversations with teachers indicated they had little 
or no knowledfre oT the objective, yet there were some conversat;i ons 
which revealed that the role-playing situations had been dir,cussed. 

2.1.3 There was no evidence that a consultant was engaged to visit class- 
rooms for purposes of observing behavioral teaching patterns • The 
Acting Project Director had no knowledge that this had been accom- 
plished, and it is felt that it was not. 

2.1.^ Some seminars were held to improve teacher understanding in areas 
of cultural awareness. -The frequency of such seminars decreased 
as the year progressed. Reaction from teachers ranged from "These 
were excellent", to "These sessions have done more to alienate 
teachers than anything else - they presume we are stupid". 

It appears that Project management did not communicate the overall 
purposes of this objective effectively, and that this failing, in 
turn, generated its share of resentment. 

2.1.5 Examination of two school libraries indicated that the video tapes 
of simulated cultural situations were not available.. Libraries 
visited were Sells & Topowa. It is strongly suggested that the 
Advisory Caramittee review any such tapes prior 'to purchasing, or 
the effects may be more Jiegative than positive. 

2.1.6 It is not within the purview of the SWCEL Evaluator to decide how 
video tapes of simulated cultural situations should be disseminated 
by USOE, but it is again strongly recommended that the Advisory 
Committee review the tapes thoroughly prior to any dissemination. 

2.1.7 There is no evidence that either of these sections was accomplished. 
& Communications with the Acting Project Director indicates that 2.1.2, 

(2.1.8) 2.1.3, 2.1.7, and 2.1.8 were not done. 

2.1.1 - 8.1 

The development of a rating scale to measure affective behavior 
is a major undertaking. For example, the University of Illinois* 
Group Effectiveness Research Laboratory, Department of Psychology, 
as a contractor to the Office of Naval Research, devoted many 
years to the task of developing and validating such instruments ■ 
as the semantic differential, the behavior differential, and 
other social distance scales used to assess cultural behavior 
relationships. 

SWCEL should not have attempted to develop a new instrument in 
the short time available , but rather should have researched the 
field for instruments already validated and used in similar 
educational research projects. 

The SWCEL instrument lacked . quant if icat ion, it failed to isolate 
stimulus conditions, and it was not validated prior to use. 

In retrospect, the entire objective. was weak, though its intent 
was clear. 
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rM .1. - H. l (colli.. ) 



It ii^ up [a) Projccli Management to (h.^Lormino what Lo do in LIk,) 
teacher afCoctivo behavior area. Considerable revjijion I.g 
necesnary to bring the intent of this objecbive into u rip;orous 
design. 

Since the insti'ument selected to measure the performance 
criterion lacked validation data, it cannot be determined 
whether the performance objective was met or not met. 

3. General Objective 

To increase motivation by means of an open curriculum. 

(Evaluator's comment: The evaluation design for this objective states, 
"'o reduce student drop-out ratio".) 

3.1 Performance Objective 

As a result of exposure to the motivational program, Q0% of the target 
population will by June 1972 have increased their self-image (attitude) 
as evidenced by gain scores of administered pre-post attitude inven- 
tories. 

3.1.1 A self -appraisal inventory, developed by the UCLA Center for the 
Study of Evaluation Instructional Objectives Exchange, Intermediate 
level, was administered to regular classroom students in grades 
3-8 at each target site. 

Student responses were not obtained anonymously, and it is highly 
questionable, according to the publisher, whether the instrument 
should be used if an individual puts his name on the response form. 
Anonymity would heighten the validity of the evaluation. 

The intermediate level self -appraisal inventory was intended for 
grade ranges and should not have been administered to 3rd 

grades . A primary level of the self -appraisal instrument does 
e^ist for grade levels K-3. 

There is a secondary ' level of the inventory to be used in grade 
. levels 7-12. 

3.1.2 Motivational Kits were purchased and delivered to the target sites. 
These Kits contained well-developed materials in the form of book- 

■ lets and tapes designed to assist the adult listener in matters of 
realizing success "through achievement of goals and objectives. 
The materials were commercially prepared, and intended for general 
usage by any career worker, and were not specific to the problems 
of the educator or classroom teacher. 

With a minimum of interpretation, the materials could have consider- 
able benefits to teachers and other adults in the Project. The 
Project management staff is capable of making such interpretations 
CO that these materials might be of more practical use. 

The materials are not appropriate for students. Tiie materials are 
tailored to the adult mind^ and rely on experience and judgmental 
development which the elementary school child has not realized. 
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3.1.2 (cont.) 

The enterprising teacher could, through hours of work, reproduce 
the materials so hhab they would have value for the children. It 
Is ihc writer un/l{rrr;tn.ndin^ tliat the piJblishr:^r has developed a 
Kit, r.ui Ui.L) 1 1;? I*(if clri Idrt'n, and It is tsu^z/'icyted that Project Matiri/50- 
menl. af)po;i.nt ;j, (Mmirti.i, U.oo of teachers to rcovlc^w fi.ric] rccoinmcrid whcihcr 
such a Kit shou.hi be purchased. 

In r'etrospect 5 the expenditure of monies to purchase the original 
Kits, if these were to be utilized by the students, appears most 
wasteful. The expenditure can be justified only if the motivational 
effort was directed towards adults. The question arises as to 
whether the Kits were reviewed thoroughly in the first place. 

3.1.3 The school libraries visited were well equipped with literature 
revealing tribal cultures. It is assumed that school librarians 
could easily determine usage by referring to the borrower's card. 

3.1.4 Displays of locally produced materials revealing cultural matters 
were observed in visiting selected classrooms . There did not 
appear to be any plan where such materials could be shared with 
other sites . . 

It is suggested that teachers need more assistance in the deve- 
lopment of native language instructional materials, and that 
Community Representatives and other parents could be of assistance 
in this task. 

3.1.5 Field trip planning on the major scale, (i.e. W.ashington D.:C.), 
failed to materialize. The logistics involved in such an under- 
taking are awesome, and perhaps the locally planned, short duration 
trip has the equivalent educational enrichment value for elementary 
school children. 

The principal at Hotevilla deserves singular praise for his well- 
planned and skillfully executed field trip to Mesa Verde National 
Park. 

Field trips to the botanical gardens ' and Zoo in Phoenix also 
appeared productive. 

The trip that some Sells students took to Tucson to visit a 
first-class restaurant and enjoy a costly steak dinner does not 
appear to fit the criterion of educational enrichment. The 
children probably would have enjoyed hamburgers better. 

3.1.6 The Project newsletter does not report that cross-cultural educational 
programs were presented by students. The idea is great, and should 
be pursued. This type of presentation would have high interest 
level. 

3.I.T It is assiimed that these programs were intended for the students. 

The SWCEL evaluator has no direct evidence that Project Management 
arranged f or such programs . 

3.1.8 To keep the design consistent between pre and post administrations, 
the intermediate level self -appraisal inventory was administered to 
all regular classroom students at all sites, grades 3-8. The post- 
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3.1.8 (cent.) 



administralM.on, i* iini hir to the pre-adinini fst ration > was not p.iven 
anonyraouis ly , excofU. on an experimental basis with tlie hth [rrado 
teacher ah Topowa. Tlio MWCEL Evaluator and the teacher Sf/.roed 
thai", iiiore validil.y woujd result from anonyrnoui'. respotir.es, 

3.:i.i - 8.1 

Data are reported In the Addendixm, Mean scores measuring the 
peer, family, school, and general self-image concepts are 
shown on a pre-post basis, ly school, and by classroom, 
(sites not identified) 

Through discussions between the new Project Director, the 
Superintendent, the Project Coordinator, the Project Community 
Representative, and the SWCEL Evaluator, it was agreed that 
^ SWCEL would respect the confidentiality of the individuals ' 

self -concept responses, that sites would not be publicly 
identified, and that the dissemination of the data would be 
subject to the discretion of the Project Director. 

It is recognized that counselors, and perhaps teachers, might 
have legitimate requirements for the individual data, but 
such- requirements will have . to, be communicated to the Project 
Director. 

From a program standpoint, it may be stated that improvement 
was noted in self-images between pre and post adminir.trations . 

In view of the validation data of the instrument, (group 
validity rather than individual validity), it cannot be stated 
whether the performance criterion, as stated, was met. 

It must also be stated that no component of the evaluation 
design appears .to relate to the open curriculum, (refer to 
general objective), and that no component of the ; evaluation 
design appears to assess directly the student drop-out ratio. 

General Objective 

To increase effective special education prograjns . 

(Evaluator 's comment - The Evaluat ion dos ign indicates that this objective 
is, "To increase the achievement of hbidicapped students in basic skills.") 

k.l Performetnee Objective 

As a result of exposure, application and utilization of the Montessori 
Program (K-6), JO^' of the handicapped students in the target sites 
will be achieving basic skills at grade level by June 19T3, as 
evidenced by results of standardized achievement tests. 

l+.l.l Wide Range Achievement test was administered to a few special edu- 
cation children at post-testing time. Extended use of this instru- 
ment for all special education children is incorporated in the' 
evaluation design for the' second project- year . * (ih one , case , a 
young girl at Sells who scored -. 1- mihus in ' grade- equivalent total 
reading based on SRA testing , scored 3>T^grade level with the WRAT ! ) 
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The reference to Arizona State Lav is unclear. If special ediica- 
tion children require, by State lav, testing .above and beyond that 
of other children, the writer is unaware of this requirement. From 
a psychological standpoint, it is hoped that t]u^3 is not the case, 
for it would p].ace a "legal label" on the child which could have 
deleterious effects. 

k.l*2 MvViitessori materials were purchased and distributed to special 
education classrooms • Teachers involved did not have special 
training- in the use of Montessori materials., In the case at 
Sells, these materials remained in a school closet for some time. 
Several teachers were cycled in and out of the special education 
classroom at this site, and finally a teacher arrived who was 
entirely dedicated to the needs and interests of special education 
children (i,e. Miss Forbes). 

^.1.3 There was no carpeting in the special education classroom at Sells. 

The SWCEL Evaluator does not recall seeing carpeting in the special 
education classroom at Sacaton, 

U,1,U Not accomplished. This is a priority item for the next' pre-service 
workshop • 

Visits were held at the three sites, and informal discussions 
between representatives of Project Management and the special 
education teachers indicate that, attention was given to this area. 

The major problem appeeirs to be one of sensitizing regular class- 
room teachers to the unique teaching difficulties with special 
education children, and to avoid the tendency of using special 
education classes as a disciplinary vehicle for poor-per forming 
students. In the teacher's lounge at Sells, for example, the 
following comment was heard from a regular classroom teacher, 
"Many of my kids are stupid - they belong in Special Ed." 

^•1.6 The monthly newsletter is an excellent vehicle to report Project 
activities.- A few articles, with pictures ^ showing Special Edu- 
cation activities, might well serve to enhance motivation and 
recognition for these handicapped youngsters, 

U.l.T The appropriate level SRA achievement test was administered on a 
pre-post basis, to Special Education children at the three sites. 
Reading skills and arithmetic skills were assessed. ; 

Data are reported in the Addendiam. Results are highly encouraging, 
especially in arithmetical achievement. 

It should be noted that one teacher at San Carlos Rice, (i.e. Miss 
Batson), refused to let the test administrators, (both of whom were 
experienced Albuquerque Public School Educators), give the reading 
tests at post-test time. Her statement, "These kids are non- 
readers", may well be true. A void in the evaluation design is 
only a minor consequence of this action. Giving the test mip;ht 
■ have exposed' the children to an unsuccessful experience, to be sure 
Not giving the test could only have the eff.ect of telling- the child 
"My teacher doesn't believe I have learned reading skills - I must 
be dumb." 
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h.l.'J (contj 



If we continually label Special. Education childi-en as inferior, 
the self-fulfilling prophecy will surely work. 

Some Special Education classes used Distar reading programs. 
These classes were given the Distar Mastery Test, This accounts 
for lack of complete SRA testing at post-test time, 

h.1.1 - 7.1 

Clearly, the results show that Special Education children, 
including EMR children, do learn, though at a decelerated 
rate. 

Recognition of their handicaps, empathy from the teacher and 
others in contact with the. child will help immensely in 
improving the skil]^.. 

The performance criterion correctly takes the decelerated 
learning rate into consideration in calling for' a June 1973 
assessment , 

From a broader standpoint, looking at the general objective 
of increasing the effectiveness of Special Education programs 
in the ilight of the needs assessment stiody done by the BIA on 
rural Indian children in Arizona, Project Management has a 
long way to go in establishing a viable, systematic, compre- 
hensive total program. There would indeed be more than 
children in the Special Education Category, if this were the 
case , ■ 

General Objective • ' 

To increase the involvement of the parents in the target sites. 

5.1 Per fomance objective 

Seventy percent of the parents at the six selected sites will by 
June 1, 1972, as a result of (a) refurbishing a building and super- 
vising a study-social room for the students to be used from 3: 00 PM . 
to 9:00 PM, Monday through .Friday, (b) assistance in making tapes 
and f ilmstrips • on Tribal Culture for the Project, arid (c) their 
attendance at- six out of eight town hall type meetings, increase 
their involvement, as evidenced by the results of project question- 
naire and record, keeping data, 

5.1.1 Discussions were held with the assigned Community Representative- 
to Project Management for purposes of ascertaining this individual' 
opinions in the area of this general objective. The activities of 
the Advisory committee included the recommendations to Project 
Management on curriculum matters. Mr, Machu Kay, Chairirian of the 
Advisory Committee, sponsored a resolution f ran the Advisory 
Committee which called for a review of ell testing materials by 
that committee, prior to administration to Indian children, 

5.1.2 According to the Community Representative , the parents at some . 
sites were very active in arranging the study-social room. On. 
the other hand, this was not true at all sites. 
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5.1.3 Adult recreational activities 6ind vocational classes were held in 
the evenings in at least one site (Hotevilla). Community Action 
Program (CAP) used the facility at Peach Springs. 

5.1.^ The SWCEL Evaluator has no data on parental attendance at town hall 
meetings. It is the understanding, that Project Management was com- 
piling data from the sites for a report. 

The Community Representative felt that her services were not fully 
utilized. She felt she could assist in getting more representation 
from the Indian Community on the Advisory Committee, for example. 

.The SWCEL Evaluator attended two meetings of ^he Advisory Committee. 
This group has a. definite contribution to make which can assist in 
all objective areas. 

Since the group is Advisory in nature to Project Management, and 
.^since the group is representative of the Indian Tribal groups, it 
seems inappropriate that members of Project Management, (i.e. 
school administrators), should be simultaneously: voting members 
of the Advisory Committee. 
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ADDENDUM 



1. SELF-APPRAISAL Inventory (SAl) 

Instruiiient used was .IjiLermodiate level SAI, developed, by TnBtruct/ional 
Objectives Exchange, UCIA Center for the Study of Evaluation. 

This instrument assesses self-concept in four categories: peer 
relationships (P) , family relationships (F), school relationships (S) 
and general self-image (g). 

Data are reported by mean raw scores by classroom and by site, on a 
pre-post basis. Sites are not identified in the interests of safe- 
guarding the confidentiality of the data. Project Management has been 
given all data necessary to interpret these results. 

Mean Raw Scores SAI 









Pre- 


-Test 






Post- 


-Test 




Site 


Classroom 


P 


F 


S 


G 


P 


F 


S 


G 


A 


^1 


9.5 


10.1 


11.1 


10.1 


8.2 


11.9 


10. k 


10.il 




^2 


10.0 


13.5 


11.3 


11.7 • 


9.0 


10.9 


8.8 


10.0 




^3 


9.6 


11.5 


10.8 


10. k 


9.3 


10.8 


8.3 


11.1 




A 

h 


10 .2 


12 . 0 


11. 2 


12. 5 


11. d 




O . u 


11 . 4 




As 

5 


9.2 


11.5 


7.3 


10.6 


11.0 


13.6 


7.7 


11.7 




D 


11.2 


11.6 


7.7 


10.7 


11.9 


11.6 


Q.k 


11.5 


■n 

B 


^1 


9.2 


11. O 


7.0 


9.6 


11.9 


Ij. J 


10 . 4 


IJ . d 




2 


9.0 


9.1 


6.2 


8.1 


9.1 


9.7 


6.2 






®^ 


10.0 


11.9 


9.5 


11.0 


11.5 


12.5 


7.2 


13.7 


C 




8.6 


10.2 


9.6 


8.9 


10.8 


11.7 


12.5 


12.0 






7.9 


12.2 


11.9 


9.3 


10 . 0 


' 11.7 


11.2 


11.1 






11.5 


12.7 


11.2 


12.2 


12.1 


li|.3 


10.0 


11.5 






9.0 ■ 


12.9 


10.6 


9.8 


10.8 


13.3 


9.8 


11.3 






11.7 


12.3 


11.2 


11.0 


11.2 


11.1 


7.2 


10.0 




^6 


10.7 


12.8 


11.2 


10.7 


10.0 


12.1 


11.8 


10.8 


D 


^1 


12.1 


11.9 


15.3 


12.6 


12.5 


12.8 


13.2 


12.5 






11.3 


12.7 


13.5 


10.9 


9.7 


lii'.O 


. 12.0 


10.8 




^3 


11.5 


■ 13.5 


12.8 


ll.il 


10.5 


12.9 


11.5 


11.8 


E 


^1 


9.6 


10.1 


11.6 


10.8 


9.2 


9.5 


10.0 


8.9 




^2 


8.8 


10.3 


8.5 


9.0 


8.0 


10.2 


6.6 


9.h 




^3 


9.k 


12.6 


■ ll.k 


11.3 


10.7 


15.5 


ll.k 


10.7 
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Mean Raw Scores 


SAI (cont 


.) 












Pre- 


-Test 






Post- 


-Tpc?t 

X c 0 u 




0 n o c ay* r^rsTn 


P 

■I 


F 


S 




P 




Q 


n 


^1 


Q 6 


12.5 


12.9 


11 S 


y • H 


1 1 U 


10 8 


10 .Q 


F 

2 


10.0 


10.3 


11.0 


9. It 


10.3 


13.8 


11.6 


11.0 




11.0 


iV.O 


ll.it 


11.2 


10.7 


13. it 


9.9 


ll.il 




10.5' 


11.6 


10.5 


11.2 


10.2 


13.8 


10.2 


11.1 


^1 




1 1 ft 

J. J. • u 






10 1 


12 7 


1"^ 7 


11.0 


2 


10.8 


10.7 


11.2 


11.6 


10.8 


12.5 


11.9 


10.9 


^3 


8.9 


12.3 


9.8 


10.7^ 


12.0 


12 . 0 


8.7 


10. )4 


% 


6.2 


10.9 


7.2 


9.8 


10.0 


11.3 


8.3 


10.5 








Mean Data 


by Sites 














Pre- 


-Test 






Post 


—Test 




R n t p 


P 


F 


S 


Cr 


p 


F 


S ' 




A 


0 0 


9.8 


9.9 


11 n 
J. J. . \j 


in 1 




(8 7) 


11 . 0 




Q li 


10.9 




y • 0 


1 n ft 


11 8 


7 Q 


IP 1 




0 0 


12. 0 


10.9 


1 n 


1 n ft 


12.^ 


(10 4) 


11.1 


D 


11 6 


12.7 


13.9 


11 6 


(in Q V 


' 1 2 


flP P) 


11 .7 


TP 


9.3 


11.0 


10.5 


lU . H 


9.3 . 


11. f 


/A ^ V 




F 


10.3- . 


12.1 


11.5. 


10.8 


(10.2) 


• 13.1 


(10.6) 


., 11.1 


G 


9.1^. 


11.4 


10.2 


■ 10.8 


10.7 


12.2 


10.7 


(10.7 



Of the 28 possible categories, gains we're evidenced in 20, and decrements in 
8. The child's concept of his school relationships, (S.); indica.ted a decline 
in five sites. Perhaps this is a natural tendency towards the end of a school 
year'. . ' 

From the standpoint of the total Project, children demonstrated improvement 
in self -concept in peer relationships, family relationships, and general 
self-image. The only category which showed. a decline was school relation- 
ships. ^ " . 

By categories, children had the strongest positive self-concepts at both ' 
pre-test and post-test in family relationships, followed .closely by general 
self-image. 

The categories of school relationships and peer relations were 3rd and ifth . 
respectively at- pre-test time, and these positions were reversed at' post- ' • • 
test time, v**, .. V 

In STiramary, while gains did occur in the self-concept area, as measured by 
the SAI, Project Management should recognize the seriousness of a decline 
in the child's concept in relation to school. The priority .on motivation . .• 
is justified. " " 



WIDE RANGE ACHIEVICMENT ITSSTING - TOPOWA 

First grade children at Topowa were administered the WHAT in lieu of the 
Distar Mastery Test since these children had not received Distar training. 

The decision to use the Wl^M\ (reading section )> was made with the con- 
currence of the Topowa Principal and Reading Specialist, 

Results are given in the following table; 



Name 



Raw Score 


Grade Equivalent 


25 


1.2 




16 


Kde. 


6 


18 


Kdg, 


7 


ik 




)< 


22 


1,0 




21 




g 


20 




8 


28 


1 k 




21 




Q 


23 


1.1 




32 


1 6 




16 


Kdg, 


0 


27 






25 


1 2 




10 


Kdg, 


2 


2h 


1.2 




28 


1 U 




31 


1,5 




26 


1.3 






26 


1.3 




27 


1.3 




25 


1.2 


Mean 


23 


1.1 




27 


1.3 




25 


1.2 




22 


1.0- 




26 


1.3 




27 


1.3 





23.lt 



1.1 
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Prom the validation data of the WRAT, (reading section), the mean raw 
scores for children of ages years to 7 years on this instrument are 
32,25 and 39.85 respectively. Corresponding standard deviations are 
10.72 and 12.30. From the raw score data, and after checking birth dates 
of the children, it is evident that this group is well below the national 
average in reading skills. 

SPECIAL EDUCATION DATA 

SRA L^vel 2-4 was the instrument used to assess reading and arithmetic 
skills at pre-testing. The instrument worked successfully in two classrooms, 
(San Carlos Rice/Rentaria, and Sells), but proved to be too difficult for the 
other Special Ed classrooms, (San Carlos Rice/Batson and Sacaton) . In the 
latter cases, many students failed to achieve at the minimum grade equivalent 
level for which the test was designed. 

For this reason, the lower primary level SR\ was used at post-testing* The 
upper grade equivalent peak out point on this instrument is Grade 4 plus, 
rather than Grade 6 plus, as is the case in the SRA Level 2-4, It was tound 
to be a more valid instrument for use with these children. 

Data are reported by grade equivalents on a pre-post basis. Reporting raw 
scores would have no value since the test levels differ. 

Grade Equivalent Scores - Sacaton 

Reading Comprehension & Vocabulary 

Post-Test 
Comp Voc 



1.8 1-3 

(not tested) 
1.5 2.6 
1— 1.7 
1.1 1.5 

(not tested) 

( ) 
1,1 1~ 

1— 1,9 

(not tested) 

1.5 2^6 
1.1 2.2 

The inappropriateness of the SRA Level 2-4 instrument is evident from 
examining pre- test results. 

Several students were not post-tested, but did take the Distar Mastery 
Test. 

The improvements noted are encouraging. 



Name 



Pre-Test 
Comp Voc 
.1 

.4 



.1 



.6 



.2 

.6 2.1 

(not tested) 
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Grade Equivalent Scores - Sells 
Reading Comprehension & Vocabulary 



Noiiie 



Pre- 


-Test 


Post -Test 


Comp 


Voc 


Comp Voc 


2.1 


2.3 


2.8 2.5 


1 


1 — 


2.3 2.1 


2.3 


2.h 


(left school) 


]_ 


J- — 


17 13 

-L . 1 -L.J 


U.i 


3.1 


Uplus 2.9 


1~ 


1~ 


2.1 :.3 


1~ 


1.8 


(not tested) 


2.1 


2.1 


2.U . 2.5 


l.h 


2.1 


(not tested) 


1~ 




1~ 1— 



The Evaluator inquired why Rufus Levis was in the Special Ed Class, 
since he was obviously far superior in reading skills than the other 
students. The tpacher advised that Rufus was assigned to Special Ed^ 
for reasons of discipline. It is recominended that Project Management 
investigate this situation, and hopefully Rufus will be reassigned to 
a regular classroom. 

Martha Rios, upon request by the Special Ed teacher, was given the 
WRA.T. She scored a 3.U grade level equivalent! I 

The above data support the statement that children with mental handi- 
caps can learn, but at a decelerated rate. 

Grade Equivalent Scores - San Carlos Rice ( Batson ) 
Reading Comprehension and Vocabulary 



Name 



Pre- 


-Test 


Post-Test 


Comp 


Voc 


Ccrap Voc 


1— 


1~ 


(nof tested ) 


1— 


1~ 


(not tested) 


1~ 


1~ 


(not tested) 


1— 


1~ 


(not tested) 


1— 


1— 


(not tested) 


1.7 


1~ 


1.7 1~ 


1— 


1~ 


(not tested ) 


1— 


1~ 


(not tested) 


1~ 


1~ 


(not tested) 


2.2 


1~ 


1.1 1.1 


1.7 


1— - 


2.2 1~ 


1— 


1~ 


(not tested) 


2.7 


2.U 


2.7 2.3 


1~ 


1~ 


l.U 2.1 



The inappropriateness of the SBA Level 2-U instrument for this class 
is again demonstrated by the pre-test data. 

The teacher requested that many students not be tested. (See coimnents 
in Section U of Report). 

These students took the Distar Mastery Test. 
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Or ado Equ IvuLont So ore n - San Carlos Rloo ( nentarla ) 
Reading Comprehension and VocalDulary 



Name 




Pre-Test 


Post-Test 




Voc 


n onrn 


Voc 


1— 


1— 


(not 


tested) 


2.2 


1— 


2.k 


. i.T 


2.3 


2.1 


2.8 


2.3 


1.5 


2.2 


(not 


tested) 


1.6, 


1.6 


1.8 


1.9 


1.8 


2.3 


(not 


tested) 


1— 


1— 


1— 


2.3 


1.6 


1.8 


2v3 


2.1 


1.6 


2.1 


1~ 


2.2 


2.6 


2. It 


(not 


tested) 


2.3 


l.li 


(not 


tested) 


(not tes 


ted) 


1.1 


2.3 


(not tes 


ted) 


1.6 


1.1 



The decelerated learning rate is again reflected "by the data, 
These students also took the Distar Mastery Test. 

Grade Equivalent Scores — Sacaton 
Arithmetic Concepts, Reasoning and Computations 



Name 



Pre-Test 




Post-Test 


Con 


Rea 


Comp 


Con Rea Comp 


1~ 


2.6 


2.1 


1.9 2.3 3.U 


1— 


1~ 


2.2 


(not tested) - 


1— . . 


1.1 


1.1 


(not tested) 








1— 1.6 2.7 


1™ 


2.1 


1.1 


(not tested) 
(not tested) 


1— 


1— 


1— 


1~ 


1 


1.3 . 


(not tested) 


1— 


1— 


1~ 


(not tested) 


1— 


1.5:; 


1— , 


1„ 1.6 2.7 


1~ 


1— . 


1~ ■ , 


(not tested) 


1.5 


1.8 


1~ 


(not tested) 


1.5 


1.5 / 


1~, 


: (not tested) 


1— , 


1— ; 


'l.S 


1.2 1.9 2.8 


(not t 


.ested) 


1.1 1.5 2.8 



The post-testing team vas under the assumption that since these 
students vere in a Distar Math Program:, they would not "be .post 
tested with the SRA. The regular teacher did some testing as in- 
dicated a"bove.;. 

Based on pre-test scores, the SRA. Level 2-U proved inappropriate, 
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Grade Kquivalent Scores - Sells 
Arithmetic Concepts, Reasoning, and Computations 



Pre-Test 



Post-Test 



Name 



Con 


Rs3. s 






2.2 


1~ 




l.h 1— 1.7 


2.5 


1~ 


1.1* 


1.1 1.3- 3.1 


1.8 


1.5 


2.5 


(left school) 


2.3 


1~ 


l.h 


1.7 1— 2.5 


2.5 


2.1 ■ 


3.h 


2.8 2.7 l*plus 


1.3 


1.8 . 


2.7 


1.7 ■. 1— 3.8 , 


1.3 


1.8 


1— 


(not tested) 


2.k 


2.1 


, 1.1 


2.3 1.2 2.7 


3.2 


.1.5 


2.1 


(not tested) 


1.1 


1.5 


1— 


1.8 1— 1— 



The data reflect that Special Education children can handle compu- 
tations reasonably well, while concepts and mathematical thought 
processes are more difficult. 

There appears .to be more success in teaching Special Education 
children arithmetic than reading. 

Grade Equivalent Scores - San CbtIos Rice ( Bats on) 

Arithmetic Concepts, Reasoning and Computation 



Name 





Pre-Test 


Post-Test 


Con 


Rea 


Comp 


Con 


Rea Comp 


1~ 


1~ . 


1.1 


( not 


tested) 


1~ 


1~ 


1~ . 


' .1— 


-1--' l—- 


1.8 


1" 


1.5 


1.2 


1— 2.U 


1— 


1— . 


1.3 


1~ . 


1— 2.9 


1" 


1— 


1.3 


l~ ; 


1.5 2.7 


2.1 


1~ 


2.6 


(not 


tested) . 


1.3 


1— 


2.9 


(not 


tested) 


1.1 


: i~ 


1- 


l.U 


1.5 2.k 


1.3 


.1— 


2.2 


,1„. 


1~ 2.6 


1-8 


. i~ ■ 


2.6 


.1—. 


2.2 1.6 


(not tested) 


1.5 


1.9 1.7 


1— . 


i~ 


1~- 


1~ 


1~ 1— 


1.8 




3.5 


2.3 


1.6 3.1 


1.6 


i~ 


1.8 


: 1— 


1.2 3.3 



Pre-test results indicate inappropriate test instrument. , 

Improvement in computation skills is encouraging, demonstrating that 
EMR children can : learn . 
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Grade Equivalent Scores - San Carlos Rice (Rentaria ) 



Arithmetic Concepts, Reasoning, and Computations 



Name 





Pre-Test 




Post-Test 


Con 


Re a 


Comp 


Con 


Rea Comp' 

r 


1.7 


2.1 


1-- 




(not tested) 


1.5 


1— 


1.5 


1.2 


1 — 1.9 


1.8 


2.6 


3.3 


2.1 


1.4 3.8 


2.7 


1.5 


2.9 




1.7 2.4 


2.5 


2.1 


2.8 




(not tested) 


2.4 


1.5 


3.2 


1.8 


2.2 2. -5 


1.7 


2.1 


1.4 


1__ 


1— 1— 


2.5 


2.3 


3.2 


2.3 


2.3 3.3 


2.3 


1.5 


2.7 


1-- 


1.7 1.8 


2.7 


2.3 


2.1 




(not tested) 


2.8 


2.3 


3.7 


2.1 


2.9 2.5 


1— 


I— 


2.7 


1.5 


1— 1.9 



Thesp. children, in many cases, performed better on the pre-test than on the 
post-test. This could be due to many factors, perhaps faulty test admini- 
stration. 
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J^. RliPORT OP CONSULTANT SERVICi; 
^•ouLhvn'KU'rn CUioiu. ra i Lvo KducaLionnl Labcn-atory, Inc. 



Date of Report 4-19-72 



N'lTao 



Mrs. Helen R. Yoakum 



PosiLion Reading Specialist- 



Dates of 
Service 



4-1^/15-1972 



:Midercd O'/^^i t ton report .group p^rttcinatiari ^tc,V ob 
and xnt ervxewxrig phiTsoxiSa^I at PeacH ' SpTfiAge^ 



serve 



NnLiirv.' ol" Scrvici.- re 
reading program 

Friday - attend HEE p Co-ordinating Meeting— Observation and Intervie ws 
Sat. - attend general meeting of HEiiD work Affective Bphavior 
FJ.a<y»tn f f - Observ ation and Interview - acted in advisory caoacitv - 

Rosume of recommendations (please attempt to be as concise as possible) tb'^Lab? 

1. Dxstar and Field Reading good - Some lack of training in use 'of 
P^aterxals especially need mo r e cultural-ethnic direction materi als/ 

rxela Enterprises ^ • - ~ ~~- — ~ — — . ■ . ■■ -r ■■ 

2. Improve testing pr digr am - material needs to relate to culture - 
Teachers need to be "in" on testing program - ethnic background . 
and to readxntc level of children. 



3. Improve communications with people on sites - especially Indian 

tribal representatives. 

^' Reading program should develop oral language kish program to 

— =- support reading development. 

^' f^g'^g^fHl^S*'?^'' F^^^^"g^°^^^^°P« - opg '^ classroom-actxvxty as ba se 
Kesu..%f ,^fa^?gn,X,ftM«4?#rLce. and general remarks. Please complete a one or 

tivo page iiarrative relative' to topics covered. I was asked by Dr. Hugh es to 

evaluate the reading program of HEiap Pro -ie^t ^^ it pertained to the 
objectives set out in the HEiap Project report. I went to the Project 



mfiSedbaaig with Dr. H 



Hughes to see the reading 



program in action^ to me e t 



and talk with the teachers involved in the program, and to meet the 
Advisc^y Committee of HE£d Project. Then^^^^^^^^^^ the Affective 

Behavior teach-in at Flagstaff to meet the teachers and administrators 
from all six of the concerned HE£d sites. The following observations 
are based upon comments made to me directly and overheard in the genera l 

^^ll^^^LL^^ of the progr^ and meetings • 

l^n actionv My conclusions are generalized, summarized, and organized 
[(^-cording to objectives stated in the program. 



B*' - 09a . ; Page 2 

Rev. 12/67 

ReporL of Consultant Service - cont. The teachers were s^"^^^g^J-J-y concerne d 
with the reading program^ They were disturbed by the testing program, 
both material and method of adtnini strati on > They showed littl e concern 
with affective behavior for themselves, only as the ir children demon- 
strated it > They felt many of the workshops so far had been worthle ss, 
b ut wanted oral language and English as a second language work shop 

developed^ 

Reading; Teachers were primarily concerned with reading, oral language 
developiqent and cultural-e thnic reading materials. All teachers expressed 
satisfaction with the Oistar program* Most had had a workshop on how to 
use it and felt it had been worthwhile. (Most were using rotating station 
organisation in a semi-open classroom orgf^nization. ) One had had no 
workshop and was using Distar in the conventional classroom organization, 

and several had had only a little pre-use instruction. While teache rs 
liked the Field Enterprises series, they felt they could benefit from 
in-service training in the use of materials and me thods of teaching. 

A,ll teachers requested something be done to help them to develop 

an oral language program with emphasis on English a s a second language 
to aupport the reading program. Teachers all expr essed vital concern 
over the lack of cultural-ethnically oriented reading and oral language 
development materials. (During the lunch bre ak, I took several of the 
participants to the Northe rn Arizcjia Museum where they found a dozen or 
more titles suitable for eleme ntary grades, to help develop their 
cultural-ethnic libraries, some of which were written in duel languages, 
English and Navajo, or -bhiglish and Hopi. (Mr. Garcia , Many Farms 
Principal , comm^^nted upon the effectiveness of the illustrations for 
use in developing concepts in the non-verbal affective domain. ) In 

. ■ / (Signed) : ■: . 

■ERIC"/ ",• .U3) \ 



addition, Mrs. Ipharr ordered booklists to bp distributed among the 
six concerned sites. I have promised to send more titles (and biblio- 
graphies) as I locate them.) 



Teacher Training : Comments on teacher training ranged from good (Distar) 
to waste of time. The small number of teachers attending the Dr. 
Galloway's program on Affective Teacher Behavior was a stark commentary 
on the involved teacher's attitude about their training exi^eriences. 
Those teachers in attendance seemed favorably impressed with Dr. 
Galloway's ideas ^ and expressed a desire f or taaEsap additional workshops 
in the area of affective behavior. 

1^ Affective Behavior ; 

No teacher expressed an opinion on being evaluated in the affective 
behavioral domain^ because, it seemed to me, they seemed to have very 
little concept of this objective as expressed in the HEiiD program. 

Testing : All teachers and principals talked most about the testing 
materials as being unsuitable for the students being tested and that the 
people doing the testing were not suited. to the job they were asked to do. 
Direct quotes from teachers, principals, and Indian leaders of the program 
were : 

Tests didn't go well. 

Tests didn't measure what was being taught. 

Tests should be adapted to children who are going to take them. 
Teachers eaxd directors of program should evaluate the tests before 
they are given to be sure that they are suited to the ethnic -cultural 
background of the students being tested and in both subject matter, read- 
ing difficulty, and construction of tests. 
Tests should not be given by kids. 

Short skirts in terf erred with attention of students. Short skirts 
were not suitable dress^^v f ^ r ^^'^ 7cf:>At'^*,^ 

Students who gave tests did not care about results of first test, 
only that tb^ s<=*cond test showed up better than the first. 

T'5sts w^re not culturally or ethnically related to thA students. 
Teacher's ought to be traiAed to give tests and just be supervised 
by the lab people. 

T'^st'^rs didn't want teachers in the room during testing. 

ERIC- . ...^^) ; : ' ... 



Gf^nftrally, the t*^ach<=^rs f<^lt the tests wer<^ poorly administered , 
that strangers produced a distracting element and insecure testing 
condition for their students, that the students will perform b<«^tter for 
the familiar t«=*acher« They were even more concerned because the tests 
w^re not culturally related to the area, therefore students naturally 
would not, could not srhow up vrell in tiie results. One principal stated 
th^ problem and feeling succinctly, '^I didn't look at the results of 
thp t'^sts. I wasn't interested. I knew what they were going to be.<» 
The teachers also felt left out of the testing process. My opinion is 
that teachers who feel left out or pushed out have little or no desire 
to know the results ox tn** tests and will respond little to feed-back 
data . 

Recommendations ; 

I. Redesign testing program. Tests must relate to the ethnij ^logical 
background of the students. The Indian leaders are particularly Loihappy 
v/ith present conditions. In developing process evaluation tests, employ 
competent peoplr^ to develop reading content with relevant subject matter, 
suitable r'^ading levels, and consistent format of testing material items. 
Simplify and clarify testing directions for both administration and for 
students taking the test. Involve teachers in testing procedures. 

II. Develop the ethnic-cultural reading materials for the children 
in areas of both reading and oral language development to support and 
extend correct reading programs based on bi-lingual, English as a 
second language, linguistic structures. 

( Premise ; Reading and ivriting abilities are based upon the al>,ility 
of the student to handle the language structures orally • Concepts 
are based in oral language before they are read about or written. ) 

III. Teacher workshop or in-service training in the following areas: 

a. Concepts and classroom management of open classroom 

b. Nonverbal communication (teacher affective behavior domain) ' ^ 
(also teacher-student relationship development, especially in the 
area of motivation. ) 

c. Reading--developing culturally-ethnically related reading 
materials, and developing more innovative methods for teaching 
the particular children involved in the program. 

d* Oral language bi-lingual materials and methods of teaching. : 
Relationships with white administrators of HEii^D and SWC^iL soems 




to be good but th^rf? sft^ms to be a serious breakdovm in rapport with 
the Indian leaders as to the purpose of the testing program and of the 
Lab^s ability to produce a reliable and valid testing program A'^^^ore l 
effective communication between Indian leaders and teachers in HEiiiD 
with Lab may h^lp establish rapport in this area. 

V. If it is decided to proceed with evaluations of affective teacher 
behavior, before preceding with them it would be well to insure that 
teachers understand what affective behavior is, how the evaluation 

affects them, aad that the evaluation tools are appropriate and that 
the evaluators are thoroughly experienced, knowledgeable, and sympa- 
thetic (or, based on comments about current testing programs, I predict 
revolt). 
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PROJECT IIEED ^./OMSHOP 




AUGUST a - 18 . 


AUGUST 8th 




8:30 -.9:30 
Chemistry 208 


Dr. Virgil Gillenvrator, Executive Vice President 
of NAU. ^'Welcome to Northeina Arizona University'' 


9;30 - 10:00 


Coffee Break 


10:00 - 11:30 
Chemistry 208 


Introduction of Project HEED staff. Orientation 
session regarding HEED objectives, sites, personnel 
and pre/post test design. 


1:00 - 3:30 
Chemistiy 208 


Continuation of above j i.e. , study-social rooms, 
fieldtrip guidelines, educational materials, 
consultants, evalmtor, and project auditor for 
1972-73 


AUGUST 9th through AUGUST 11th THE INDIAN VFAY . 


8:30 - 9:30 
Chemistry 208 


Pimas - Introduction Iqr riamie Sizeraore 
Presentation by Nelson Jose 


9:30 - 10:00 


Coffee Break 


10:00 - 11:30 


Anna More Shaw 
Agnes Allison 

Gila River Day School Dancers 


1:00 - 3:30 


Papagos - Jir. Tony Chico 


8:00 - 10:00 P.M. 


Get Acquainted Mixer - Holiday Inn Ballroom 


AUGUST 10th 




8:30 - 9:30 
Chemistry 208 


Apaches Mrs. Delores Cassadore 


9:30 - 10:00 


Coffee Break 


10:00 - 11 :30 


Apaches (continued) - Phillip Cassadore; 


1:00 ~ 2:30 


. I. D. Processing, Room 111 , Student; Affairs Building 


2:30, - 3:30 
Chemistry 208 


Hopis - Dr» Griff en "Biculturalness and its Major 
.Implications" . 



AUGUST 11th 



8:30 - 9O0 
Chemistry 20S 

9:30 - 10:00 

10:00 - 11 :30 

1 :00 - 3:30 
Chemistry 20G 

AUGUST 12th 

8:30 - 9:30 
Chemistry 20G 

9:30 - 10:00 

10:00 • 11 :30 
Chemistry 208 
Chemistry 203 

1:00 - 3:30 

AUGUST 13th 

A UGUST Uth 
Chemistry 208 

AUGUST 15th 

3:30 - 9:30 
Chemistry 208 

9:30 - 10:00 

10:00 - 11 :30 
Chemistry 208 

Chemistry 203 
1:00 - 3:30 



Navajos - Dr, Goosen »''The Navajo and His Langiiage 



Coffee Break 
Navajos (continued) 
Haulapais - Mrs. Vfatahomicie 



Presentation by 14rs, Ifergot Shoaf , Sacaton 
School Bi3.siness Office. 

Coffee Break 



Section A - Teachers and aides attend Indian Youth Panel 
Section B - Principals meet v/ith Project Staff 

Guided tour of Musem of Northern Arizona ^ Flagstaff 

All day; educational field trip to Grand Canyon 

All day uith appropriate coffee and lunch breaks 

Dr, Orval Hughes, Southvrestern Cooperative Laboratory > 

Presentation of pre/post test results of program for 1971-72 

Oral Language Program 

Quality Assurance Specialist 

Pleinforced Readiness Requisites Program 



Dr. Rambeau - "Reading and the Indian Child" 
Coffee Break 

Section A - Motivational KitSj Teachers K-S 
Charles Bisbee & Mrs. Hennard 

Section B - Special Education teachers and aides > 
"Individualized Programs" - Dr. Millar 
and Mrs . KcFarland 

Continuation of Sections A and B 
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AUGUST 16th 



8:30 - 9:30 
Chemistry 20C 

9:30 - 10:00 

10:00 ^ 11 :30 
Chemistry 203 
Science 203 

1:00 ~ 2:30 
Chemistry 203 
Science 203 
Science 213 

2:30 ^ 3:30 



Dr. Rosenblum - ''Reinforcement Theory^' 



Coffee Break 



Polo C. de Bacaj Grades K-4. 
Nancy Harris, Grades 5-8 

Small Groups Practicm 
Dr. Rosenblum 
Mr. C. de Baca 
Mrs. Harris 

>irs. Sizemore - "language and Culture Courses" 



AUGUST 17t h 

Chemistry 203 
Science 203 
Science 213 

A UGUST 15th 

3:30 - 1:30 

Chemistry 203 
Science 203 
Science 213 

2:00 - 3:00 
Chemistry 208 



All day with appropriate coffee and lunch breaks 

Distar K-3 - Bonnie Bruington 
Field ^-6 - Nancy Harris 

Montessori - Special Education - Virginia Opincar 



Hith appropriate coffee and lunch breaks 

Distar K-3 - ilaiylou Carpenter 
Field - Nancy Harris 

Montessori - Special Education - Virginia Opincar 
Written examination - teachers and aides 
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